dsh-plugin-auxiliary-runtime: DSH Cancellable Auxiliary Model Calls and Source Retention Usage Ledger

dsh-plugin-auxiliary-runtime is a community Host plugin for DSH, designed to manage auxiliary model calls that do not enter the main Session transcript. It addresses issues such as source confusion, lack of concurrency limits, and difficulty in controlling usage statistics. Its core features include binding cancellable calls to live Sessions, implementing per-Session policy restrictions (such as maximum concurrency, call count, and total token usage), and maintaining an auxiliary usage ledger independent of the official tokenUsage. The plugin provides three usage views: Official, Auxiliary, and Combined, persists data to storageDomain, supports Session fencing to prevent interference from old data, and in...

Read More